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Method for controlling an optical pick-up for reading data 
streams for simultaneous reproduction 



5 Field of the invention 



This invention relates to a method for operating' a 
scheduler for an optical pick-up. The pick-up reads data 
streams from an optical storage medium, wherein the data 
streams belong to different data types like audio, video or 
subtitles, and are distributed to several files on the 
storage medium. 
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15 Background 

Pre-recorded or self -recorded optical discs may support 
"Out Of Multiplex" (OOM) formats. Out of multiplex is a 
format that stores different presentation components, e.g. 
video, audio and subtitles, on different locations on the 
disc, i.e. different files. This may be possible with 
various standardized media, e.g. Blu-ray disc. Also, a 
video technique known as multi-angle, or seamless angle 
change, may be implemented. It is well known from DVD- 
Video, and it means that a video film may contain multiple 
video tracks that are parallel on the time-line, wherein 
each video track usually shows the same scene from a 
different perspective. The user may select a perspective, 
e.g. by pressing a dedicated button. It is a requirement 
that switching between the different video tracks is 
performed with minimal delay, and that the tracks are 
integrated seamlessly into the video. 
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•During playback of OOM formats, a number of the 
presentation components need to be decoded separately, and 
then presented synchronously and continuously, i.e. without 
noticeable interruption of the presentation. Therefore it 
> is required that each of the decoders is provided with a 
continuous stream of data. On the other hand, optical 
drives are usually equipped only with a single pick-up 
unit, which is capable of reading only one data stream from 
the disc at a time, at a higher data rate than required by 
any of the decoders. That means that the pick-up has to 
jump from stream to stream in order to serve all decoders 
simultaneously. This" requires buffering, i.e. the data that 
are read from the disc are fed into properly sized buffers, 
wherein each of the buffers is associated with a decoder 
Buffering the coded data is more effective than buffering 
the decoded data. Thus, any decoder is provided with a 
continuous data stream. 

Feeding the buffers requires a scheduling algorithm, 
because any buffer under-run must be prevented for a 
continuous presentation. The buffer sizes strongly depend 
on the applied scheduling scheme. 
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A pick-up usually contains an actuator carrying an optical 
sensor, and the pick-up is movable by a mechanical drive 
for raw adjustment, while the actuator is separately 
movable for fine adjustment without a mechanical drive. 
When the pick-up has to read multiple streams, this 
requires a much higher pick-up jump frequency than a 
single, multiplexed stream. 
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Summary of the Invention 

One problem arising from the fact that multiple files must 
be read simultaneously is the high pick-up jump frequency 
5 causing noise and wastage due to the mechanical drive A 
further problem is the delay appearing during seamless 
video angle switches. The delay is the time needed from 
requesting the video angle change until seeing the other 
video angle, it is determined mainly by the video buffer 

10 size, or by the amount of time until the video buffer has 
run empty and the new content reaches the video decoder 
The same applies to the start up of OOM decoding. The time 
passing by from pressing the start button until effectively 
starting the display is quite long, since all buffers must 

15 be filled from scratch. 

A problem to be solved by the invention is to provide a 
scheduling method for controlling a pick-up such that a 
reduction of the pick-up jump frequency is achieved, while 
20 using a minimum of buffering space. This problem is solved 
by the method disclosed in claim 1. 



Advantageously, a method for reducing the delay times 
required for angle switch can be included. This method is 
25 disclosed in claim 6. 

Another problem to be solved by the invention is to reduce 
the delay times required at presentation start up. This 
problem is solved by the method disclosed in claim 8 

30 

The inventive method leads to a lower pick-up jump 
frequency and thus achieves noise reduction and improved 
pick-up durability. According to the invention, this is 
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achieved by employing an appropriately adapted scheduling 
raster, and by individually increasing the lower-rated 
buffers by a small amount of memory. The proposed 
scheduling raster is static, i.e. based on a fixed time 
constant, and thus independent from the actual buffer 
filling. Further, the method provides a technique for OOM 
decoding that reduces the switching time for seamless angle 
changes. For a HDTV stream, the typical application of Blu- 
ray disc, the buffers are quite large. The large buffers 
cause a long delay for the user waiting for a requested 
angle change to get visible, which delay can be reduced by 
the inventive method. The same problem arises for the 
start-up of OOM decoding. According to the invention, the 
problem of optimizing the start-up or video switch 
15 procedure for the proposed scheduling scheme can be solved 
by filling the buffers only partially, such that the buffer 
filling situation matches with an optimal position in the 
static scheduling scheme. 
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According to the invention, it is possible to interrupt the 
scheme by an angle change request, and return to the scheme 
after serving the request, when the normal scheme is such 
that for any three successively read data streams, wherein 
the second is the video data stream, the first or the third 
data stream is also the video data stream. 

Advantageously, the invention can also be used to optimize 
the partitioning of a given amount of buffering space for 
the described application. 

Advantageous embodiments of the invention are disclosed in 
the dependent claims, the following description and the 
figures . 
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Brief description of the drawings 
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Exemplary embodiments of the invention are described with 
reference to the accompanying drawings, which show in 

Pig.l an exemplary buffer filling diagram for a static 
scheduler; 



Fig. 2 a diagram showing an optimized start-up procedure; 

Fig. 3 the principle of delayed services due to a user 
request; 



Fig. 4 service interruption by a user request; and 
Fig. 5 video service interruption by a user request. 



Detailed description of the invention 

In the following, a detailed description of the invention 
including a detailed analysis of the problem is given. 
Though the invention is suitable for any number of data 
streams, the typical application case of three streams is 
described here, namely video, audio and subtitle streams. 

OOM decoding is mainly influenced by the following mutually 
dependent parameters: 

the maximum data rate of the pick-up R D , 

the maximum pick-up jump time Tj, 

the pick-up jump frequency f jump , 

the maximum data rate of the first component stream R v , 
the size of the corresponding buffer B v , 
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the maximum data rate of the second component stream R A/ 
the size of the corresponding buffer B A , 
the maximum data rate of the third component stream R s , 
and the size of the corresponding buffer B s . 

The pick-up jump time is the maximum time required by the 
mechanical move of the pick-up to a new position, ending 
when data from the new stream reach the buffer. This time 
may depend on the data allocation on the medium. The order 
of the component streams is the order of their data rates, 
i.e. the first component stream has the highest data rate 
R v , the second stream the second highest data rate R A etc. 
Therefore, in the typical application mentioned above R v 
refers to the video stream, R A to the audio stream and R s to 
the subtitle stream. The buffer sizes B V ,B A ,B S do not 
encompass any decoder internal buffers, and thus are 
independent from e.g. any special decoder. 
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Further, a basic system time constant T and integer numbers 
n and k are introduced. According to the invention, the 
system time constant T is selected such that the buffer of 
the component with the highest data-rate, e.g. video, is 
being continuously emptied and refilled in periods of T, 
while all lower rated component buffers are emptied and 
refilled in periods of multiples of T. Fig.i shows buffer 
fillings of an exemplary system according to the invention 
during a complete pick-up cycle, assuming a situation where 
all buffers already contain data and are continuously being 
read, and assuming that when a buffer is being filled it is 
being filled completely. Consequently, the pick-up data 
rate R D must be considerably higher than any of the read 
data rates R V ,R A ,R S , which is a realistic case. 
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in Fig.l, at a certain time t 0 the pick-up is idle since 
all buffers contain data. The pick-up position, depending 
on its previous action not shown, may be on the video 
stream, if the position is another, the pick-up jumps to 
the video stream within a time of not more than Tj . Then it 
reads video data and fills the video buffer B video within a 
time of t fill , v . when the video buffer is full at a time t lf 
it requires no further refill within a time period of 
t leak ,v. During this time the pick-up jumps to the subtitle 
stream, requiring a jump time of Tj , and fills the subtitle 
buffer B sub within a time of t £ill , s . Then at the time t 2 it 
jumps back to the video stream within Tj . In the inventive 
system the buffer sizes are selected such that at the time 
t 2+Tj , when the video data reach the video buffer B^, the 
buffer still has enough data to continuously provide the 
decoder with data. The video buffer is refilled, and then 
at a time t 3 the pick-up jumps to the audio stream, since 
the audio buffers requires refilling after another Tj 
After filling the audio buffer during t fill . A the pick-up 
returns to the video stream. The described schema is 
continued such that the pick-up reads the highest rated 
stream and any of the lower rated streams in turn, meaning 
that when it has read any one lower rated stream to fill a 
corresponding buffer B audio/ b s1 *, it always returns to the 
highest rated stream, and reads that stream at least once 
to fill the corresponding buffer B vldeo . m other words, at 
least one out of two successively read data streams is the 
stream with the highest data rate, m this respect, the 
schema is static. 

Advantageously this schema can also handle components with 
vanable data-rate, up to a maximum allowed data rate 
Variable data-rate of a component simply causes a higher 
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remaining buffer filling level than calculated, at the time 
the buffer is refilled, and therefore results in quicker 
filling. However, according to the invention this shall not 
influence the scheduling raster. Instead, it results in 
some additional pick-up idle time. 



An important aspect of the invention is that each of the 
lower rated component buffers, i.e. audio and subtitles, i 
being refilled and emptied at its own time -constant, 

10 wherein the time-constant for the audio component is n*T, 
and the time-constant for the subtitle component is k*n*T. 
As defined above, T is the time required for a complete 
cycle of filling and emptying the buffer for the highest 
rated stream, and n and k are integer numbers. Therefore 

15 the inventive scheduler is static also with respect to 
accessing the lower rated streams, i.e. the lower rated 
streams are accessed in a constant predetermined order. In 
the example shown in Fig.l the audio stream is always read 
twice before the subtitle stream is read once, bearing in 

20 mind that before and after every audio or subtitle stream 
access the video stream is read. This can be formally 
described by n=2 and k=2 . 



Another important aspect of the invention is the 
25 distinction between n one-service-periods" ISP and "two- 
services -periods" 2SP. A "one -service -period" ISP is 
defined as the time T between two successive peak fillings 
of the video buffer, wherein the pick-up performs only one 
service, namely reading video data. Contrary, a "two- 
30 services-period" 2SP is defined as the time T between two 
successive peak fillings of the video buffer, wherein the 
pick-up performs two services, namely reading video data 
and reading data from a lower rated stream. Therefore any 
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"two-services-period" 2SP requires the pick-up to jump 
twice, while any "one- service-period" ISP requires no pick- 
up jump, and therefore provides some pick-up idle time, 
thus giving flexibility, as required below. In general, the 
inventive schema does not force the video buffer to run 
empty during these periods, as exemplarily illustrated. 
E.g. the buffer could also be kept at a certain level until 
the next service period starts. 

The resulting frequency of pick-up jumps, in the following 
called the "jump -frequency" is for a system with three 
streams defined as 

f - 2 I 2 2(k + l) 

Jjump "n.T + vn :== i^rT (Eq - 1) 
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It means that two pick-up jumps are required to the medium 
rated stream within a time of n-T, and two further pick-up 
jumps to the lowest rated stream within a time of n-k-T. The 
buffer sizes for all components and the system time 
constant can be calculated according to the following 
20 equations . 
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A general relation describing the filling or emptying of a 
buffer of size B is 

R (Eq.2) 

R is the resulting filling or leakage rate, i.e. filling 
the buffer with a filling rate R takes a time of t, and 
emptying the buffer with a leakage rate R also takes the 
time t. If the empty buffer is filled and emptied 
simultaneously, with the difference between leakage rate 
and filling rate being R and the filling rate being higher, 
it also takes a time of t until the buffer is full. 
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Thus, the following equations describe the filling and 

reading processes for three individual components, as shown 
in Fig.l: 

B A B A 

5 n-T = t ~„ ,+t 7 , . = — + (Err 3 2) 

fill, A leak, A R -R R v^q.J.^; 

D A K A 
B B 

k - n - T = t fill,S +t leak,S = T-^r + f- (Eq - 3 ' 3) 

D S S 



with n being in the range of [2,n max ] and k in the range of 
[l/kmaxl • Further, the system time constant T obeys to 
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B v B A 

T = 2-T.+ + d (Eq.4) 

J R D~ R V R D~ R A 



This allows calculating the required buffer sizes according 



to 



15 ^-2 ^"^ 
R D -R v -n.R A 

_ s t jK- r aK 

R D~ R V~ n ' R A 



B A =1 »/_» (Eq.5.2) 



n-k.T[R D -R s )R s 



and the system time constant according to 
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General assumptions for this scheduler are 

^ = 2 (Eq.6.1) 
= 1 (Eq.6.2) 

5 Since the denominator in eq.5.4 must be positive, this 
means 

R D ~ R V 

max /? (Eq.6.3) 
A 

As a result of the different leakage rates for audio and 
subtitle buffers follows 

R A 

10 k = -A 

max r (Eq.6.4) 
S 

The resulting jump- frequency is 

/ ^2(^+1) _ (* + !X*p ~n R J -R v ) 

jump „. k . T kT (Eq.7) 

j D 

15 To achieve minimal buffering requirements for the scheme, n 
and k are chosen to their minimal values n=2 and k=l, for 
the case of three presentation components. 
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In one embodiment of the invention, preferably the 
parameter k may be increased (k=l...k max ) in a first step. 
This results in a reduced pick-up jump frequency with 
requiring only little additional buffer size. In another 
embodiment of the invention the second step is to increase 
also the parameter n (n=l... ninax ) to reduce the frequency of 
pick-up jumps even further. 

Advantageously, the invention allows minimizing the start- 
up delay of a presentation. Fig. 2 shows how this may be 
achieved by selecting the optimal entry point into the 



10 



15 



20 



25 



30 



WO 2004/088657 PCT/EP2004/002996 

12 

scheduling raster and an appropriate buffer filling 
sequence. At system start-up T sta rt / the video, audio and 
subtitle data need to be read from the disc and written 
into the associated buffers Bv ide o, B audio , B sub . when this 
procedure has finished, the presentation can start. 
According to the invention, the start-up sequence is such 
that the buffer for the highest rated stream, i.e. video, 
is filled last, after the buffers for the lower rated 
streams are already filled. However, different start-up 
procedures are possible, resulting in different delay 
times. Possible entry points S,S* into the static 
scheduling raster are when the filling of each buffer is 
such that the corresponding decoder can start working. The 
inventive method of selecting the optimal entry point for 
minimal start-up delay chooses the possible entry point S* 
where the required amount of data in the audio and subtitle 
buffers is the smallest compared to other possible entry 
points S, so that they require minimal filling time before 
the presentation starts. The start-up procedure shown in 
Fig. 2 begins at T start with moving the pick-up to access 
first the subtitle stream within a time of Tj , reading the 
appropriate amount of subtitle data required at S*, then 
moving the pick-up to the audio stream and reading audio 
data as required at S*, and then moving the pick-up to the 
video stream and reading video data at last. At the time S* 
the video buffer has enough data to start the video 
decoder, and thus the presentation. It is assumed here that 
the buffered amount of audio and subtitle data is 
sufficient to start their respective decoders, since S* 
must be selected correspondingly. 



It is also possible that e.g. during presentation start-up 
one or more data streams must be read from the medium that 
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are required only once, e.g. configuration data, and that 
can be processed at the data rate provided by the pick-up. 
Therefore, all described procedures refer only to those 
data streams that are continuously required for the 
> presentation. That means that the described static schedule 
starts at presentation start-up time S*, and may be 
flexible before and after the presentation. 
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In one embodiment of the invention, the process of reading 
the lower rated streams at start-up is optimized such that 
the streams are read in the same, or reverse, order that 
they have on the medium, depending on and starting from the 
current pick-up position. This minimizes the number of 
pick-up jumps required during start-up. 

As another advantage, in one embodiment the inventive 
method reduces delay times required for seamless angle 
changes. This can be achieved by delayed servicing, as 
shown in Fig. 3. The scheduling raster is selected such that 
the audio buffer B audio and the subtitle buffer B sub have a 
period of 4-T, i.e. n=4 and k-1. Using the above-mentioned 
flexibility of the pick-up during one -service -periods, it 
is possible to handle angle change requests at any time, 
however assuming that the time between successive requests 
is more than 2-T, which is not unrealistic. Delayed 
servicing can be used when in the normal scheduling raster 
after any two- services -period a one-service-period follows. 
This means that if the second of any three successively 
read data streams is the video data stream, then also the 
first or the third is the video data stream. Advantageously 
only an actuator movement is required when reading the same 
stream twice successively, no pick-up movement. 
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Fig. 3 shows a situation where an angle change is requested 
at a time T a when the video buffer has just been filled, 
and according to the schedule the audio buffer has to be 
filled next, since it is almost empty. This would be a 
regular service S r . In order to prevent any interruption of 
the running presentation in such situation, and 
simultaneously achieve only minimal angle switch delay, the 
best solution according to the invention is to serve the 
angle change request with priority, and serve the audio 
buffer in a delayed service S d . This means to move the 
pick-up, when an angle change is requested, within the jump 
time Tj to the appropriate position on the disc where the 
requested video stream can be read, flush the video buffer 
down to the lowest possible angle switch position as 
described below, and read the new video stream into the 
video buffer. Then the audio buffer can be served, after 
another pick-up jump time Tj . This requires that the audio 
buffer can bridge the time period t d from its regular 
service S r start time to the delayed service S d start time, 
and thus the audio buffer B audio must be larger than 
calculated above. Analogously, the same applies for the 
subtitle buffer B sub . The time t d to be bridged corresponds 
to the load time of the video buffer, and thus is shorter 
than T. The additional amount of buffer space AB auaio , AB^ 
25 can be calculated to 
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^ audio 



AB ,= 
sub 



■ + T. 



{R D -Ry J J 



R A (Eq.8.1) 



' +T. 



R 



S (Eq.8.2) 



The additional buffer space, and thus the additional cost, 
30 depends directly on the data rate. Therefore this 
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embodiment of the invention comprises an increase of buffer 
space for the lower rated streams. 
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To finish the angle switch process according to the 
invention, the scheduler returns to the original scheduling 
raster. This may be achieved by interrupting the delayed 
service S d for the audio buffer at a time T d . a when the 
filling of the audio buffer is the same as it would be if a 
regular service S r had been performed before. Thus, the 
audio buffer may return to the original scheduling raster. 
Then the pick-up may jump to the video stream and fill the 
video buffer, until at a time T d , v the filling of the video 
buffer is the same as it would be if no angle change had 
been requested before. Thus, also the video buffer may 
return to the original scheduling raster. 

In one embodiment of the invention introducing "service 
interruption" may further reduce angle switch delay, as 
shown in Fig. 4. This means that in the case of a video 
angle change request the video buffer is served with 
priority, even if the pick-up is busy with serving another, 
e.g. the audio buffer. Thus, the lower prioritized service 
is interrupted. In Fig. 4 the video buffer is full at a time 
T a , and the pick-up is moved within the pick-up jump time Tj 
to the audio stream, which in this example is the next 
stream in turn. At a nearby time T a ' , either during the 
pick-up jump or during the following regular audio service 
S r , a video angle change may be requested. According to the 
invention, the video stream is prioritized such that the 
pick-up is moved immediately, at T a ' , to the new video 
stream, not completing the audio buffer service. After the 
pick-up jump time Tj the new video stream is read, and when 
the video buffer is full, the pick-up returns to the 
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interrupted audio service. After another period of Tj the 
audio buffer continues to be filled. ' 
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As described above for a delayed service S d , the scheduler 
returns to the original scheduling raster by filling the 
audio buffer not completely, but only up to the level that 
it would have if it had been served regularly. When this 
level is reached at a time T d , a ' , the pick-up is moved back 
to the video stream, and the video buffer is flushed down 
to the lowest possible angle switch position, as described 
below. Then the pick-up fills the video buffer up to the 
level that it would have if no angle change had been 
requested. At that time T d , v ' the system has returned to the 
original scheduling raster, and may continue with it. 

The described service interruption requires another 
additional buffer space for the lower rated stream buffers, 
because an additional time of 2-Tj must be bridged. Thus, 
the equations eq.8.1 and eq.8.2 become 
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AB 



audio 



2T.+ 

J R~-R 



V) 



R 



(Eq.9.1) 



AB 
sub 



2-T.+ v — 

J R^-R 



V ) 



R. 



(Eq.9.2) 



The lowest possible angle switch position is used for 
buffer flushing, as mentioned above. In OOM, video 
sequences may contain angle switch labels that mark 
positions, where a seamless angle change is possible. 
According to one embodiment of the invention, these angle 
switch labels are stored together with their associated 
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video data. The scheduler may determine the lowest possible 
angle switch position by selecting the first angle switch 
label above a certain minimum buffer filling level B v 
also called bonding label. This level By l9in can be 

5 calculated as the amount of data that is required to 

continue video presentation until the new video data arrive 
at the buffer, roughly after a time of plus a decoding 
time that is usually negligible. Buffer flushing means that 
the video data beyond the bonding label are overwritten 

10 with the new video data. 
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In a further embodiment of the invention the angle switch 
delay may also be improved for the case that an angle 
switch is requested while the video buffer is being served, 
.15 as shown in Fig. 5. Advantageously, this leads to a shorter 
recovery time between two successive angle change requests, 
or to a recovery time that is less dependent on the video 
contents. Since the delay time between the request for an 
angle change and its presentation depends on the remaining 
video buffer filling up to the bonding label, and therefore 
depends also on the current video data rate, it may be 
unacceptably high for low video data rates. Fig. 5 shows a 
delayed service S d for audio data, as described above, and 
the pick-up returning to the video data stream at a time 
T d ,a, taking a jump time of Tj. At a time T a " , which is later 
than T d , a and could be e.g. within Ta.a+Tj or while the video 
buffer is being filled, a video angle change may be 
requested. As a worst case, Fig. 5 shows T a " being equal to 
Ta.a+Tj. To handle this situation, in this embodiment of the 
invention also a delayed service for video is possible, 
meaning that the scheduler interrupts the pick-up reading 
the current video stream and moves it to another video 
stream that contains the video data for the requested 
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angle. It may take an additional delay time of Tj+T^p to 
have the video visible, where T GOP is the duration of a 
video access unit that is sufficient for decoding. In the 
case of e.g. an MPEG video stream, this is a group-of- 
pictures (GOP) . Generally Tgop is the minimal amount of a 
certain type of data used for decoding. T GOP was neglected 
in the previous examples since for audio and subtitles it 
is considerably less than Tj . It could be added without 
changing the achieved results by replacing Tj with "Tj+Toop" 
where T^p refers to the audio or subtitle decoder. To 
support delayed service, the video buffer must bridge the 
additional delay time T j+ T GO p, wherein it is sufficient to 
assume Tj+Tcop always being less than T. The video buffer is 
therefore enlarged by the minimum amount of 
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~ V 7 ) + T GOP ) (Eq . 10 ) 



Generally it is assumed that any buffer mentioned in this 
20 disclosure may be replaced by a plurality of cooperating 

buffers. Further, it is possible that buffers for different 
data streams may be implemented in a single device. 

Advantageously, the invention can be used for devices that 
25 construct multi-media or audio-visual (AV) representations 
from data read from a storage medium, e.g. an optical 
storage medium such as a DVD or Blu-ray disc, wherein a 
single pick-up reads multiple data streams. 
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More generally, the invention can be used for devices that 
construct any combined data representation from a plurality 
of data streams that are read from a single storage medium, 
e.g. optical storage medium, wherein the data streams are 



WO 2004/088657 PCT/EP2004/002996 

19 

read by a single pick-up and the data streams have 
different data rates. 



